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DETAILED ACTION 
Response to Amendment 

This communication is responsive to Amendment A, filed 09/13/2004. 

Claims 1-40 are pending in this application. Claims 1 , 25, 29, and 37 are 
independent claims. In the Amendment A, Claims 1, 5, 10, 14, 21, 25, 28, 29, 37, and 
38 were amended. This action is made Final. 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 



Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

Claims 1-16, 19, 23-27, 29-31, 35-40 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Crater et al ("Crater," US005982362A). 

As per independent claim 1 , Crater teaches a method for interacting with a 
remote device comprising: obtaining a request corresponding to controlling at least one 



identifiable remote devices (column 3, lines 58-64); generating a graphical user 
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interface responsive to said request, the graphical user interface being operable to 
control the remote device, wherein controlling said device includes accessing said 
remote device and issuing instructions (column 3, lines 37-45 and lines 58-64); 
obtaining user control instructions from said graphical user interface (column 7, lines 25- 
36); transmitting remote device control data corresponding to said user control 
instructions (column 7, lines 25-36); and obtaining remote device data generated by 
said remote device (column 7, lines 25-36). 

As per claim 2, which is dependent on claim 1 , Crater teaches that generating a 
graphical user interface includes dynamically generating a graphical user interface 
(column 8, lines 20-25). 

As per claim 3, which is dependent on claim 2, Crater teaches dynamically 
generating a graphical user interface includes: identifying a remote device 
corresponding to said request (column 8, lines 19-36); selecting a program module 
corresponding to said identified remote device from a plurality of program modules, said 
program module operable to control said remote device (column 8, lines 19-36); 
generating a screen interface including said selected program module, said program 
module including a graphical user interface component corresponding to said requested 
remote device (column 8, lines 25-36). 

As per claim 4, which is dependent on claim 2, Crater teaches dynamically 
generating a graphical user interface includes: identifying two or more remote devices 
corresponding to said request (column 9, lines 54-62, i.e. - data from many remote 
devices can be displayed together); selecting a program module corresponding to each 
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identified remote device from a plurality of program modules, said program modules 
operable to control said remote device (column 9, lines 54-62); generating a single 
screen interface containing all program modules, said program modules operable to 
generate graphical user interface components corresponding to each requested remote 
device (column 9, lines 23-26 and lines 54-62). 

Claim 30 is similar in scope to claim 4, and is therefore rejected under similar rationale. 

As per claim 5, which is dependent on claim 4, Crater teaches that control 
instructions control the operation of all of said remote devices (column 2, lines 63-68). 

As per claim 6, which is dependent on claim 2, Crater teaches that the graphical 
user interface is a Web page (column 8, lines 19-25). 

Claim 31 is similar in scope to claim 6, and is therefore rejected under similar rationale. 

As per claim 7, which is dependent on claim 2, Crater teaches obtaining a 
request corresponding to controlling one or more identifiable remote devices includes: 
obtaining a request for monitoring data corresponding to said remote device (column 8, 
lines 19-25). 

As per claim 8, which is dependent on claim 2, Crater teaches wherein obtaining 
a request corresponding to controlling one or more identifiable remote devices includes: 
obtaining a request to transmit data to said remote device (column 7, lines 25-36). 

As per claim 9, which is dependent on claim 8, Crater teaches that the 
transmitted data causes said remote device to move (column 7, lines 25-36). 

As per claim 10, which is dependent on claim 1, Crater teaches transmitting 
control data includes: transmitting a request for accessing data from said remote device 
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(column 10, lines 49-59); and transmitting authorization for access to said remote 
device (column 10, lines 49-59). 

As per claim 1 1 , which is dependent on claim 1 , Crater teaches obtaining remote 
device data generated by said remote device includes: obtaining real-time data 
generated by said remote device (column 3, lines 12-15). 

As per claim 1 2, which is dependent on claim 1 , Crater teaches obtaining remote 
device data generated by said remote device includes: obtaining pre-recorded data 
generated by said remote device (column 3, lines 15-23). 

As per claim 13, which is dependent on claim 1 , Crater teaches that the remote 
device is a video camera, and wherein obtaining remote device data includes obtaining 
video data from said video camera (column 3, lines 12-23). 

As per claim 14, which is dependent on claim 13, Crater teaches that transmitting 
control data includes transmitting data manipulating said video camera (column 7, lines 
25-31). 

As per claim 1 5, which is dependent on claim 1 , Crater teaches that transmitting 
data includes manipulating operating parameters of said remote device using said 
graphical user interface (column 9, lines 4-12); and wherein obtaining remote device 
data includes obtaining remote device data generated by said remote device based on 
said manipulated operating parameters (column 9, lines 4-12). 

As per claim 16, which is dependent on claim 15, Crater teaches that the 
graphical user interface includes a graphical means for manipulating said operating 
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parameters of said remote device, said graphical means operable to receive user inputs 
corresponding to said manipulation (column 3, lines 62-65 and column 7, lines 25-31). 

As per claim 19, which is dependent on claim 1, Crater teaches obtaining user 
control data includes obtaining a request for manipulating operating parameters of said 
remote device (column 3, lines 62-65); and wherein transmitting remote device control 
data includes translating said request into device specific commands, and transmitting 
said device specific commands to said remote device operable to change said operating 
parameters of said remote device (column 7, lines 25-36). 

As per claim 23, which is dependent on claim 1 , Crater teaches a computer- 
readable medium having computer-executable instructions (column 3, lines 24-35). 

As per claim 24, which is dependent on claim 1, Crater teaches a system having 
a processor, a memory, and an operating environment (column 3, lines 24-35). 
Claims 35-36 are similar in scope to claims 23-24, respectively, and are therefore 
rejected under similar rationale. 

As per independent claim 25, Crater teaches a computer-readable medium 
having computer-executable components for dynamically interacting between at least 
one remote device and a computing device, comprising: a user interface application 
operable to dynamically generate a graphical user interface corresponding to the 
remote device in response to a request for interaction with the remote device (column 8, 
lines 20-25); a device interface application operable to obtain device data from the 
remote device (column 7, lines 25-36), and operable to manipulate said data (column 7, . 
lines 25-36); and a data transmittal application operable to transmit said data to the 
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computing device, and to facilitate communication between the remote device and the 
computing device (column 7, lines 25-36). 

As per claim 26, which is dependent on claim 25, Crater teaches that the 
computing device is a server computer (column 9, lines 42-47). 

As per claim 27, which is dependent on claim 25, Crater teaches that the 
computing device is a client computer (column 9, lines 62-66). 

As per independent claim 29, Crater teaches a method for dynamically 
generating a user interface for controlling at least one remote device comprising: 
obtaining a request to control at least one pre-seiected remote device (column 3, lines 
58-64); selecting a program module corresponding to said pre-selected remote device 
from a plurality of program modules in response to said request, said program module 
operable to control said remote device (column 7, lines 25-36); transmitting a screen 
interface with said program module (column 7, lines 25-36); wherein said screen 
interface containing said program module is operable to generate a graphical user 
interface when loaded within a browser application (column 9, lines 62-66). 

As per independent claim 37, Crater teaches a system for dynamically 
generating a user interface for controlling at least one remote device comprising: at 
least one remote device operable to receive control commands and to transmit 
monitoring data based on said control commands (column 7, lines 25-36); a server 
computer in communication with said remote device, said server computer operable to 
dynamically generate a graphical user interface based on said remote device (column 9, 
lines 42-47); a client computer in communication with said server computer, said client 
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computer operable to display said graphical user interface, and request said control 
commands (column 9, lines 62-67). 

As per claim 38, which is dependent on claim 37, Crater teaches a proxy server 
in communication with said client computer and said server computer, said proxy server 
operable to process and store monitoring data generated by said remote device 
(column 9, lines 15-20 and column 7, lines 32-36, i.e. - camera output signals are 
stored on a network host and transferred to a local server to be displayed on a client 
system). 

As per claim 39, which is dependent on claim 37, Crater teaches that the server 
computer and said client computer are in communication via the Internet (column 7, 
lines 37-49). 

As per claim 40, which is dependent on claim 37, Crater teaches that the server 
computer and said client computer are in communication via a dedicated device control 
network (column 7, lines 37-49). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1 , 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Crater et 
al. ("Crater," US005982362A) in view of Amini et al. ("Amini," US006698021B1). 
As per claim 17, which is dependent on claim 16, the teachings of Crater in regards to 
claim 16 have been discussed above. Crater teaches that the remote device is a video 
camera (column 3, lines 12-23). Crater does not disclose a graphical means that is a 
graphical controller including graphical representation of a compass having an origin 
and directional indicators. 

Amini teaches a graphical means that is a graphical controller including graphical 
representation of a compass having an origin and directional indicators (figure 10C, 
element 1032 and column 16, lines 1-13). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the teachings of 
Crater with a graphical means to control a video camera using a compass 
representation, as taught by Amini, with the motivation to provide an intuitive user 
interface capable of controlling camera motion relative to any initial camera position 
(column 16, lines 1-6) 
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Claims 18 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Crater et al. ("Crater," US005982362A) in view of Amini et al. ("Amini," 
US006698021B1) in further view of Brush, II et al. ("Brush," US# 5732232). 
As per claim 18, which is dependent on claim 17, teachings of the combination of Crater 
and Amini in regards to claim 16 have been discussed above. The combination of 
Crater and Amini do not disclose that the graphical controller is operable to 
communicate the intensity of said manipulation, said intensity based on the distance 
away said user input is from said origin. 

Brush teaches that the graphical controller is operable to communicate the 
intensity of said manipulation, said intensity based on the distance away said user input 
is from said origin (column 3, lines 28-35). It would have been obvious to one of 
ordinary skill in the art at the time the invention was made to modify the teachings of the 
combination of Crater and Amini with a means to indicate the intensity of user input 
based on the distance the user input is from the origin, as taught by Brush, with the 
motivation to more efficiently translate user input into desired outcomes on a graphical 
user interface and to enable a greater degree of user control of the interface (column 4, 
lines 65-67) 

As per claim 20, which is dependent on claim 18, Crater teaches remote device 
data generated by said remote device based on said changed operating parameters is 
real-time data (column 3, lines 12-15). 
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Claims 21, 28, 32, and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Crater et al. ("Crater," US005982362A) in view of Lemons et al. 
("Lemons," US006504479B1). 

As per claim 21 , which is dependent on claim 1 , the teachings of Crater in 
regards to claim 1 have been discussed above. Crater does not disclose that the 
remote device is selected from the group consisting of intrusion detection devices, card 
readers, door strikes and contacts, access control panels, bar code scanners, video 
cameras, still cameras, and microphones. 

Lemons teaches that the remote device is selected from the group consisting essentially 
of intrusion detection devices, card readers, door strikes and contacts, access control 
panels, bar code scanners, video cameras, still cameras, and microphones (column 6, 
lines 65-68 and column 6, lines 41-57 and column 5-6, lines 47-27). It would have been 
obvious to one of ordinary skill in the art at the time the invention was made to modify 
the teachings of Crater to include intrusion detection devices, card readers, door strikes 
and contacts, access control panels, bar code scanners, video cameras, still cameras, 
and microphones, as taught by Lemons, with the motivation to monitor and control all 
aspects of an integrated security system (column 2, lines 30-33). 

Claim 28 is similar in scope to claim 21 , and is therefore rejected under similar 
rationale. 

As per claim 32, which is dependent on claim 29, the teachings of Crater in 
regards to claim 29 have been discussed above. Crater does not explicitly disclose that 
the pre-selected remote device is a video camera having pan-tilt-zoom functionality, and 
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wherein said graphical user interface is operable to control said pan-tilt-zoom 
functionality of said video camera and to view data from said video camera. 
Lemons teaches that the pre-selected remote device is a video camera having pan-tilt- 
zoom functionality, and wherein said graphical user interface is operable to control said 
pan-tilt-zoom functionality of said video camera and to view data from said video 
camera (column 5, lines 60-67). It would have been obvious to one of ordinary skill in 
the art at the time the invention was made to modify the teachings of Crater with a 
means to control the pan-tilt-zoom functionality of a video camera and view data from 
the video camera, as taught by Lemons, with the motivation to control the function of 
remote video camera (column 3, lines 9-11). 

As per claim 34, which is dependent on claim 29, the teachings of Crater in 
regards to claim 29 have been discussed above. Crater does not disclose that the pre- 
selected remote device is a motion detector. 

Lemons teaches that the pre-selected remote device is a motion detector 
(column 7, lines 5-1 0). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the teachings of Crater to include intrusion 
detection devices, card readers, door strikes and contacts, access control panels, bar 
code scanners, video cameras, still cameras, and microphones, as taught by Lemons, 
with the motivation to monitor and control all aspects of an integrated security system 
(column 2, lines 30-33). 
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Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Crater et 
al. ("Crater," US005982362A) in view of Nail (US# 5758340). 

As per claim 22, which is dependent on claim 1 , the teachings of Crater in 
regards to claim 1 have been discussed above. Crater does not disclose that the 
remote device can be locked, thereby preventing the simultaneous submission of 
instructions by more than one user. 

Nail teaches that the remote device can be locked, thereby preventing the 
simultaneous submission of instructions by more than one user (column 3, lines 6-8). It 
would have been obvious to one of ordinary skill in the art at the time the invention was 
made to modify the teachings of Crater with a means to lock a remote device to prevent 
simultaneous submission of instructions by more than one user, as taught by Nail, with 
the motivation to prevent data inconsistency (column 3, line 6). 

Claim 33 is rejected under 35 U.S.C. 103(a) as being unpatentable over Crater et 
al. ("Crater," US005982362A) in view of Launey et al. ("Launey," US005086385A). 
As per claim 33, which is dependent on claim 29, the teachings of Crater in regards to 
claim 29 have been discussed above. Crater does not disclose that the pre-selected 
remote device is a temperature control device, and wherein said graphical user 
interface is operable to control said change in temperature of said temperature control 
device. However, Crater does disclose monitoring of temperature (column 8, lines 26- 
31). 

Launey teaches that the pre-selected remote device is a temperature control 
device, and wherein said graphical user interface is operable to control said change in 
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temperature of said temperature control device (column 16, lines 48-61 ). It would have 
been obvious to one of ordinary skill in the art at the time the invention was made to 
modify the teachings of Crater with a means to control the temperature through a user 
interface, as taught by Launey, with the motivation to provide a simple interface to 
control the environment of a building (column 3, lines 10-13). 

Response to Arguments 

Applicant's arguments filed 09/13/2004 have been fully considered but they are 
not persuasive. 

The applicant argues: 

a. Crater does not teach, "generating a graphical user interface responsive to 
said request". 

b. Crater does not teach, "a controller that selects a program module 
corresponding to each identified remote device in the request from a plurality of 
program modules and generates a single screen interface containing all program 
modules". 

c. Crater fails to teach that the program modules, such as applets, are 
selected based on requests. 

d. Crater fails to teach the dynamic generation of a user interface in 
response to a request. 
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In regards to argument (a), the Examiner disagrees with the Applicant. It is clear 
that Crater does teach generating a graphical user interface responsive to said request 
(i.e. "The remote computer also includes a facility for processing the instructions to 
create a user interface-that is, a visual display, which may include video and/or 
graphics, or other presentations having a predetermined format-encoded by the 
instructions, and which incorporates the data or otherwise enables the monitoring 
engineer to gain as much information about the controller as possible." Column 3, Line 
38). 

In regards to argument (b), the Examiner disagrees with the Applicant. It is clear 
that Crater does teach a controller that selects a program module corresponding to 
each identified remote device in the request from a plurality of program modules and 
generates a single screen interface containing all program modules (i.e. "In addition, a 
web page can obtain data from other web pages (e.g., from different controllers) by 
accessing those web pages when appropriate. For example, if a cluster of controllers is 
operationally related such that data from one is usefully combined with data from the 
others, each page of the cluster can contain instructions to access the other pages (or 
their associated data pages) when accessed by a user, and the applet configured to 
present data from the entire cluster." Emphasis added, Column 9, Line 54). 

In regards to argument (c), the Examiner disagrees with the Applicant. It is clear 
that Crater does teach that the program modules, such as applets, are selected based 
on requests (i.e. "The remote computer also includes a facility for processing the 
instructions to create a user interface-that is, a visual display, which may include video 
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and/or graphics, or other presentations having a predetermined format-encoded by the 
instructions, and which incorporates the data or otherwise enables the monitoring 
engineer to gain as much information about the controller as possible." Column 3, Line 
38). 

In regards to argument (d), the Examiner points out that dynamic generation of a 
user interface could be interpreted to mean generation of a predetermined user 
interface when it is requested. Furthermore, Carter teaches, "The remote computer 
also includes a facility for processing the instructions to create a user interface-that 
is, a visual display, which may include video and/or graphics, or other presentations 
having a predetermined format-encoded by the instructions, and which incorporates the 
data or otherwise enables the monitoring engineer to gain as much information about 
the controller as possible." (Column 3, Line 38) Emphasis added. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Inquiry 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Boris Pesin whose telephone number is (571) 272-4070. 
The examiner can normally be reached on Monday-Friday except every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine Kincaid can be reached on (571) 272-4063. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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SUPERVISORY PATENT EXAMINER 
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